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Abstract — In this letter we propose to denoise digital color im- 
ages via an improved geometric diffusion scheme. By introducing 
edges detected from all three color channels into the diffusion the 
proposed scheme avoids color smearing artifacts. Vector valued 
diffusion is used to control the smoothing and the geometry of 
color images are taken into consideration. Color edge strength 
function computed from different planes is introduced and it 
stops the diffusion spread across chromatic edges. Experimental 
results indicate that the scheme achieves good denoising with 
edge preservation when compared to other related schemes. 

Index Terms — Color image denoising, vector valued diffusion, 
nonlinear diffusion, Coupling term. 



I. INTRODUCTION 

In digital image restoration the primary task is to remove 
noise without changing the multiscale nature of images. There 
exists various methods for image denoising and variational- 
partial differential equations (PDE) based schemes [1] are 
powerful methods in this regard. In this paper we concentrate 
on anisotropic PDE based color image denoising and study 
how we can improve them by introducing color edges into the 
diffusion process. Perona and Malik [2] proposed a nonlinear 
diffusion function to control the smoothing across edges for 
monochromatic images. Due to the efficient denoising property 
of such class of PDEs, recently there are efforts [3], [4], [5], 
[6] to introduce them into color image denoising as well. 
Tschumperle and Deriche [7] studied such diffusion PDEs in 
one common framework and unified them under vector valued 
regularization. 

The main drawback of the current schemes is that they can 
introduce color smearing across multi-edges. Therefore low 
to medium contrast color edges are not preserved and the 
resultant image lacks clear color boundaries that are present 
in the original scene, see Figure 1 . To avoid such artifacts we 
make use of chromatic edges found in different channels into 
the vector valued regularization of [7]. It is known that [8] 
the geometry of a color image is contained entirely in the 
base intensity image. A weighted coupling is introduced to 
align and constraint the gradient responses of different color 
channels and the weights are computed from the input image. 
Thus, we make of use of not only the geometry but also the 
color information explicitly into the diffusion paradigm. 

We introduce a color edge strength function via the cou- 
pling term into the vector valued regularization scheme. This 
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Fig. 1. Chromatic edges based diffusion PDE improves the denoising result, 
(a) Input noisy image, (b) TD scheme [7]. (b) Proposed chromatic edges based 
vector valued diffusion scheme. Top row the images and bottom row shows 
the 3 color planes (RGB) of the cropped region indicated in top image in (a). 

function can be added to any of the other schemes mentioned 
as well and hence the proposed term can be utilized depending 
upon requirements. In this letter we consider denoising color 
images only, so a vector valued regularization based diffusion 
scheme is used. Apart from comparing our scheme with 
traditional diffusion based schemes [2], [3], [4], [6], [9] we 
also compare our scheme with other coupling term based 
formulations [5], [10] proposed in the past. 

The paper is organized as follows. Section II introduces the 
proposed scheme based on the vector valued diffusion model. 
Denoising results are presented in Section III, and Section IV 
concludes the paper. 

II. PROPOSED SCHEME 

A. Vector valued regularization 

Let U : Q C R 2 -> R 3 with U = (*7i, U 2 , U 3 ) represent 
a color image in red, green, and blue (RGB) space. Given 
a noisy color image Uo, the diffusion PDE of the following 
form, 



dUi 



div(T>'VUi(x,i)), xeft (z = 1,2,3), (1) 



which is iteratively applied starting with the initial value 
U(x, 0) = Uq(x). The diffusion matrix D is important in 
noise removal and is defined in terms of image gradients, 
see [1] for a review. Tschumperle and Deriche (TD) in their 
work on vector valued image regularization [7] unified such 
diffusion PDEs in one common trace based framework, 



m 

dt 



trace (TH,(x, t)) , (i = 1, 2, 3). 



(2) 



where H^ is the Hessian matrix of the vector compo- 
nent Ui and T is the tensor field defined point wise 
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Fig. 2. Chromatic edges for the noisy image from Figure 1(a). (a) edge 
indicator function A/", (b) chromatic edges found by the coupling term (4), 
(c) Canny edge detector based result for three color channels. The images are 
rescaled to [0, 1] range for visualization. 

which we describe next. Consider the smoothed multigra- 
dient, K = G a • X)? =1 W*(W*) T where G a (x) = 
(27ra 2 ) -1 exp (— |x| /2a 2 ) is the Gaussian kernel, * denotes 
the convolution operation and superscript T the transpose. Let 
the eigenvalues of K be A + , A_, and their corresponding 
eigenvectors be + , 0_. If we let J\f = ^\+ + A_ which 
acts as an edge indicator in vector images, see for example 
Figure 2(a). 

T = f_(M) 0-0 T _ + f + (AT) O+Ol (3) 

where f_(M) = (1 + (A0 2 )- 1/2 and/+(AT) = (1 + (AT) 2 )- 1 . 
Due to the use of multigradient G and its eigenvectors, the 
overall geometry of the input vector image U is captured. 
Also, the channel coupling is implicitly integrated into the 
scheme by the eigenvalues in J\f. Still smearing can occur near 
color edges which are not captured completely by the eigen 
decomposition of the multi-gradient G, see Figure 2 bottom 
row. This can be attributed to the strong chromatic edges which 
are specific to one channel and may or may not give a strong 
gradient response in other channels. 

B. Coupling based vectorial diffusion 

Following [1 1], to control the color smearing we incorporate 
chromatic edges into the regularized PDE (2) via weighted 
Laplacian computed from all three color channels. For this 
purpose we consider a coupling term of the form, 

3 



fc(U i ) = Y t (ui&U j -L> j AU i ) (i = 1,2,3), 



(4) 



j=i 



where A is the Laplacian and the uji are the weight corre- 
sponding to channel i to be modeled next. The above equation 
facilitates an explicit coupling between different color chan- 
nels and chromatic edges specific from each of the channel 
is adjusted to align themselves. The weights Ui are added to 
adjust the magnitude of chromatic edges so as to avoid data 
mixup artifacts when computing the vectorial diffusion. In this 
letter, we choose the weights using the scalar total variation 
(TV) PDE [12], 



(i = l,2,3), 



applied channel-wise starting with the initial value U(x, 0) 
Uo(x), then the weights are set to, 




where || V£|| = J(%. + Q. Thus, the weights adjusts chromatic 
edges in terms of magnitude of gradients and aligns different 
channel edges via Laplacian differences in Eqn. (4). The 
pre- smoothing with Gaussian G p is added to remove small 
oscillations which can occur due to the application of TV as 
well as to avoid outliers in gradient computations. Figure 2 
shows the importance of the chromatic edges of the image 
Figure 1(a). Thus, the scheme we propose takes the following 
form 



G p * 



W, 







■■ trace (THi(x,t)) + ^fc(Ui) 



(6) 



VU 3 



(i = 1,2,3), 



Note that the weighted coupling term (4) can be added to any 
of the vector diffusion PDEs based on Perona-Malik diffusion 
term [9] or in general to any diffusion PDE which computes 
intra-channel smoothing. The pre-smoothing parameter a can 
be chosen according to the amount of noise present in the 
input image. If a is chosen very big, we lose the small scale 
chromatic edges. Similarly, the number of iterations to run the 
TV PDE depends on the noise level, and can be fixed a priori 
which could work for a class of images. By incorporating the 
weighted Laplacian differences between different channels we 
align the high frequency content while denoising with vector 
diffusion PDE. Figure 2(b) shows the chromatic edges found 
by the total coupling term ^\ fc along with Canny edge 
detector 1 based result in Figure 2(c) for comparison. Other 
choices for the weight are possible, we chose the smoothed 
gradients as it gives a road-map to adjust and match the 
magnitudes of edges. 

III. EXPERIMENTAL RESULTS 

All the images are normalized to the range [0, 1] and 
we implement (6) by standard finite difference scheme. The 
algorithm is visualized in MATLAB 7.8(R2009a) on a 64-bit 
windows laptop with 3Gb RAM, 2.20GHz. For the TV PDE 
based smoothed weights computation (5) split-Bregman fast 
iteration scheme [13] is utilized (< 1 sec for 50 iterations for 
3 channels). The pre-smoothing parameter in (5) and in the 
multigradient K is set to a —p = 2 and the TV PDE is run 
for a fixed 50 iterations in all the examples reported here. 

The computational time depends on the number of iterations 
of the main PDE (6) and fora512x512 RGB color image 
it takes less than a minute. The first example in Figure 3 
compares the denoising result of a close-up House color 
image with the original vectorial diffusion TD [7] scheme. The 
noisy image given in Figure 3(a) is obtained by adding additive 
Gaussian noise of a = 20 to the three color channels (R, G, B) 
separately. By comparing Figure 3(b) with Figure 3(c) we see 
that the proposed modified scheme preserves edges without 
color smearing near edges as well as avoids chromatic noise, 
see the contour maps in the middle. 

Next we compare the performance of the proposed 
scheme (6) with the following schemes: anisotropic diffusion 
(PM, using finite differences) [2], Beltrami flow (KMS, finite 
differences) [3], generalized chromatic diffusion (BFT, finite 
(5) 

! MATLAB command: edge (Ui, 'Canny' , thresh, a). 
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(c) Our scheme Eqn. (6) 

Fig. 3. Comparison with vectorial diffusion scheme, (a) Noisy House image 
with its contour (middle) and combined edge map (right), (b) TD scheme [7]. 
(c) Our scheme. The proposed scheme retains the geometrical properties of 
the vectorial diffusion as can be seen from the contour (middle) and SSIM 
maps (right) in (b)&(c). Better viewed online and zoomed in. 

differences) [5] which is an improvement over the chromatic 
diffusion scheme (TSC) [4], variational regularization (BKS, 
gradient descent with finite differences) [10], vector valued 
regularization of (TD 2 ) [7], vectorial TV (BC, dual minimiza- 
tion 3 ) [6], Perona and Malik with a coupling term [9] (PS, 
finite differences). 

Figure 4 shows a comparison of the schemes output with our 
scheme result on a closeup (size 200 x 200) of noisy Peppers 
test image with a n — 20. As can be seen from the images, 
by visual comparison, color smearing artifacts appear near the 
chromatic edges in PM, BFT and KMS scheme results due 
to wrong channel mixing and diffusion transfer. On the other 
hand BKS and BC scheme suffer from staircasing artifacts 
in flat regions. The parameters involved in these schemes 
were chosen according to maximum peak signal-to-noise ratio 
(PSNR) value. PSNR for an estimated 3 -dimensional color 
image U is given by PSNR(U) = 10 log (3/MSE) dB where 
MSE = ^ xe n((J(x) — U(x)) 2 / | ft | is the mean squared error 
with U the original noise-free image, \Q\ is the dimension of 
the image domain Q. To further assess the performance of 
different schemes we utilize the Mean Structural SIMilarity 
(MSSIM) [14] which is better suited than that of PSNR in 
terms finding the structure preservation 4 . Figure 3(b) & (c) 
top right part shows the combined SSIM map of the restored 
results for the TD and our scheme. 

Finally, Table I & Table II compare the PSNR and MSSIM 
values achieved by various regularization and PDE based 
schemes on standard data set of natural color images of size 

2 https://tschumperle.users. greyc.fr/softwares.php 
3 http://www.cs.cityu.edu.hk/ xbresson/codes.html#fastcolor 
4 https://ece.uwaterloo.ca/ z70wang/research/ssim/index.html 
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(d) PM [2] 



(e) KMS [3] 



(f) TSC [4] 




(j) BC [6] 



(k) PS [9] 



(1) Our scheme 



Fig. 4. Comparison results. Closeup of result for Peppers color image 
for various schemes and chromatic edges computed with a = 2 used in our 
scheme is shown in (b). 

256 x 256 and 512 x 512, we show results for 17 images and the 
remaining results, data- sets, denoised images are available at 
figshare 5 and multispectral extension of the proposed scheme 
is straightforward. We conclude that the proposed chromatic 
edges based vectorial diffusion scheme performs better than 
other diffusion schemes and further improves color enhance- 
ment property of Eqn. (2) with multi-edge preservation. Note 
that, for images with fine scale textures (see entries for 
Baboon, Tree in Table II) our scheme has slightly lesser 
MSSIM values than TD scheme since capturing color textures 
are much harder than strong chromatic discontinuities. Exten- 
sions of the proposed denoising scheme for other videos [15], 
image decomposition [16] and demosaicking [17] can also be 
considered. 

IV. CONCLUSION 
Using the vector valued regularization method we propose 
a new color image denoising scheme based on color edges. 
The scheme performs edge preserving restoration to get better 
control of the chromatic part in a color image. Vector valued 
diffusion is used to control the geometry of the multichannel 

5 http://dx.doi.org/10.6084/m9.figshare.658958 
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TABLE I 
PSNR (DB) VALUES FOR RESULTS OF VARIOUS SCHEMES WITH NOISE LEVEL a n = 20 FOR STANDARD IMAGES OF SIZE f = 256 X 256 (NOISY 

PSNR = 22.11) and J = 512 x 512 (Noisy PSNR = 22.09). Higher PSNR value indicate better denoising result. The best results for 

EACH IMAGE IS INDICATED WITH BOLDFACE AND THE SECOND BEST IS UNDERLINED. 



Image 


PM [2] 


KMS [3] 


TSC [4] 


BFT [5] 


BKS [10] 


TD [7] 


BC [6] 


PS [9] 


Our 


Baboon J 


21.53 


21.75 


21.21 


21.84 


20.53 


23.53 


16.08 


19.51 


21.58 


Barbara J 


26.13 


26.60 


25.44 


25.95 


24.94 


27.27 


20.36 


24.47 


26.69 


Boat| 


25.05 


25.29 


24.35 


25.21 


23.34 


26.85 


18.99 


23.90 


25.81 


Cart 


26.23 


26.85 


25.35 


26.07 


24.68 


27.72 


18.86 


23.64 


25.97 


Couplef 


28.41 


28.98 


27.68 


28.10 


26.97 


29.69 


27.72 


29.21 


29.81 


F-16f 


26.62 


27.20 


25.90 


26.85 


24.65 


28.50 


18.77 


26.78 


25.42 


Girllf 


28.50 


28.76 


27.78 


27.96 


27.24 


29.56 


24.37 


27.99 


29.71 


Girl2f 


31.18 


32.11 


30.38 


31.16 


29.55 


32.59 


18.63 


23.25 


27.49 


Girl3f 


29.80 


30.74 


28.63 


29.39 


27.68 


31.04 


19.72 


24.49 


28.20 


Housef 


28.90 


30.20 


27.92 


28.93 


26.85 


30.18 


17.92 


24.81 


29.76 


IPIf 


31.54 


32.63 


30.34 


31.30 


29.13 


32.72 


23.72 


27.97 


21.27 


IPICf 


29.93 


31.22 


28.55 


29.55 


27.19 


31.13 


21.45 


28.34 


22.15 


LenaJ 


28.80 


29.44 


28.00 


28.44 


27.39 


29.84 


17.83 


22.52 


26.85 


Peppers J 


29.27 


29.80 


28.45 


28.91 


27.81 


30.07 


21.94 


29.09 


28.89 


Splashf 


32.91 


33.80 


31.87 


32.65 


31.11 


33.52 


18.85 


24.90 


31.62 


TiffanyJ 


29.87 


30.22 


29.38 


29.68 


28.91 


30.88 


13.17 


17.78 


22.58 


Treef 


25.05 


25.92 


24.20 


25.23 


23.10 


26.64 


18.99 


23.67 


25.73 



TABLE II 
MSSIM VALUES FOR RESULTS OF VARIOUS SCHEMES WITH NOISE LEVEL a n = 20 FOR STANDARD IMAGES (SIZE f = 256 X 256 AND f = 512 X 512). 
MSSIM VALUE CLOSER TO ONE INDICATES THE HIGHER QUALITY OF THE DENOISED IMAGE. THE BEST RESULTS FOR EACH IMAGE IS INDICATED WITH 

BOLDFACE AND THE SECOND BEST IS UNDERLINED. 



Image 


PM [2] 


KMS [3] 


TSC [4] 


BFT [5] 


BKS [10] 


TD [7] 


BC [6] 


PS [9] 


Our 


BaboonJ 


0.7023 


0.7073 


0.6676 


0.6887 


0.6047 


0.8225 


0.5259 


0.6815 


0.7594 


Barbara^ 


0.8358 


0.8411 


0.8125 


0.8189 


0.7964 


0.8702 


0.7792 


0.8502 


0.8812 


BoatJ 


0.7385 


0.7440 


0.7137 


0.7313 


0.6786 


0.7971 


0.6943 


0.7675 


0.8024 


Cart 


0.8379 


0.8484 


0.8094 


0.8214 


0.7863 


0.8818 


0.7766 


0.8543 


0.8880 


Couplef 


0.7225 


0.7375 


0.7000 


0.7016 


0.6825 


0.7586 


0.7210 


0.7746 


0.8044 


F-16f 


0.7992 


0.8121 


0.7797 


0.7985 


0.7469 


0.8427 


0.7747 


0.8331 


0.8593 


Girllf 


0.7550 


0.7534 


0.7367 


0.7286 


0.7247 


0.7813 


0.7212 


0.7840 


0.8142 


Girl2f 


0.8833 


0.8997 


0.8739 


0.8842 


0.8652 


0.8961 


0.8553 


0.8908 


0.9093 


Girl3f 


0.8445 


0.8509 


0.8237 


0.8289 


0.8114 


0.8609 


0.8032 


0.8551 


0.8797 


Housef 


0.7704 


0.7908 


0.7519 


0.7704 


0.7308 


0.7930 


0.7355 


0.7844 


0.8093 


IPIf 


0.9250 


0.9391 


0.9159 


0.9295 


0.9039 


0.9354 


0.9306 


0.9493 


0.9550 


IPICf 


0.9102 


0.9257 


0.8939 


0.9093 


0.8725 


0.9253 


0.9023 


0.9382 


0.9478 


Lenaf 


0.8710 


0.8728 


0.8550 


0.8550 


0.8420 


0.8936 


0.7948 


0.8748 


0.9103 


Peppers f 


0.8964 


0.8928 


0.8860 


0.8832 


0.8762 


0.9086 


0.8656 


0.9211 


0.9410 


Splashf 


0.9078 


0.9089 


0.9050 


0.9070 


0.9020 


0.9115 


0.8687 


0.9230 


0.9460 


Tiffany f 


0.8773 


0.8773 


0.8679 


0.8639 


0.8607 


0.8933 


0.7833 


0.8720 


0.9103 


Treef 


0.7056 


0.7306 


0.6786 


0.7099 


0.6382 


0.7630 


0.6754 


0.7294 


0.7578 



image and weighted coupling with total variation is used to 
align the chromatic edges. Experimental results with other 
related color image denoising schemes indicate the proposed 
approach improves the denoising capability. Color image 
decomposition with different color spaces and color texture 
preservation will be our next concern in this research direction. 
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